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Abstract 

The recently developed Life-Space-Foam approach to goal-directed human action deals with individ- 
ual actor dynamics. This paper applies the model to characterize the dynamics of co-action by two or 
more actors. This dynamics is modelled by: (i) a two-term joint action (including cognitive/motivatonal 
potential and kinetic energy), and (ii) its associated adaptive path integral, representing an infinite- 
dimensional neural network. Its feedback adaptation loop has been derived from Bernstein's concepts 
of sensory corrections loop in human motor control and Brooks' subsumption architectures in robotics. 
Potential applications of the proposed model in human-robot interaction research are discussed. 
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1 Introduction 

Recently [T] we have suggested a generalized motivational/cognitive action, generating Lewinian force-fields 
[HIS] on smooth manifolds. On the other hand, cognitive neuroscience investigations, including fMRI studies 
of human co-action, suggest that cognitive and neural processes supporting co-action include joint attention, 
action observation, task sharing, and action coordination [H [5l [6l [7] . For example, when two actors are given 
a joint control task (e.g., tracking a moving target on screen) and potentially conflicting controls (e.g., one 
person in charge of acceleration, the other - deceleration), their joint performance depends on how well they 
can anticipate each other's actions. In particular, better coordination is achieved when individuals receive 
real-time feedback about the timing of each other's actions [7]. 

2 The Action-Amplitude Model 

To model the dynamics of the joint human action, we associate each of the actors with an n— dimensional 
(nD, for short) Riemannian Life-Space manifold, that is a set of their own time dependent trajectories. 
Ma = {x^{ti)} and Mg = {y-'{tj)}, respectively. Their associated tangent bundles contain their individual 
nD (loco)motion velocities, TMa = {i'(ti) = dx^/dti} and TMp = {ijHtj) = dy^ /dtj}. 
Following [1], we use the modelling machinery consisting of: 

1. Adaptive joint action ([T])-([3]) at the top-master level, describing the externally-appearing determin- 
istic, continuous and smooth dynamics, and 

2. Corresponding adaptive path integral (O at the bottom-slave level, describing a wildly fluctuating 
dynamics including both continuous trajectories and Markov chains. This lower-level joint dynamics can be 
further discretized into a partition function of the corresponding statistical dynamics. 
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2.1 Adaptive joint action 



By adapting and extending classical Wheeler-Feynman action-at-a-distance electrodynamics [5] and apply- 
ing it to human co-action, we propose a two-term psycho -physical action (summation convention is always 
assumed): 




with Ifj = [x'{t,)-y^{tj)Y , where IN < t^,tJ,t < OUT. (1) 

The first term in ffl represents potential energy of the cognitive/motivational interaction between the 
two agents at and /3j\!] It is a double integral over a delta function of the square of interval I^ between 
two points on the paths in their Life-Spaces; thus, interaction occurs only when this interval, representing 
the motivational cognitive distance between the two agents, vanishes. Note that the cognitive (loco)motions 
of the two agents ai[x'(ti)] and f3j[y-' (tj)], generally occur at different times ti and tj unless ti — tj, when 
cognitive synchronization occurs. 

The second term in ([T} represents kinetic energy of the physical interaction. Namely, when the cognitive 
synchronization in the first term takes place, the second term of physical kinetic energy is activated in the 
common manifold, which is one of the agents' Life Spaces, say A/q, = {x'^{ti)}. 

The reason why we have chosen the action ([T]) as a macroscopic model for human joint action is that ([T]) 
naturally represents the transition map, 

A[x,y;t„tj] : MENTAL INTENTION '^^^ PHYSICAL ACTION, 

from mutual cognitive intention to joint physical action, in which the joint action starts after the mutual 
cognitive intention is synchronized. In simple words, "we can efficiently act together only after we have 
tuned-up our intentions." 

Similarly, if we have the joint action of three agents, say a^, f3j and 7^ (e.g., in charge of acceleration, f3j 
- deceleration and 7^— steering), we can associate each of them with an nD Riemannian Life-Space manifold, 
say Ma = {x^{ti)}, = {y^{tj)}, and = {z''{tk)}, respectively, with the corresponding tangent bundles 
containing their individual (loco)motion velocities, TM^ — {x'^{ti) = dx^ /dti},TMi^ = {y^{tj) = dy^/dtj} 
and TMy = {z''{tk) = dz^/dtk}. Then, instead of (P) we have 

A[t^,tj,tk;t] = ^J^J^J^ a,{ti)l3j{t,)-ik{tk)5{llk) x\ti)f{tj)z^{tk)dtdtjdtk 

+ \j 9. 9) 9'' 9' dt, (where IN < t„t,,tk,t < OUT) (2) 

with 4, = [x^t,) - y^{t,)r + [y'{t,) - z^-(ife)]' + [^'{tk) - x\t,)]\ 

The triple joint action has a considerably more complicated geometrical structure then the bilateral 
co-action ([T]). It actually happens in the common 3nD Finsler manifold Mj = MaUMf^UMy, parameterized 
by the local joint coordinates dependent on the common time t. That is, Mj = {q^{t), r — l,...,3ri}. 
Geometry of the joint manifold Mj is defined by the Finsler metric function ds = F{q^ , dq^), defined by 

— 9rs{<lTQ)<f J (where g^s is the Riemann metric tensor) (3) 

^Although, formally, this term contains cognitive velocities, it still represents 'potential energy' from the physical point of 
view. 

^as well as its A^D— generalizations 



2 



and the Finsler tensor Crst{q,q), defined by (see pfTU]) 

^rst [q, q) - 4 Q.rQqsQqt - 2 dqrdqs ' 

From the Finsler definitions ©-([l]), it follows that the partial interaction manifolds, U M^, Mp U My 
and Ma U My have Riemannian structures with the corresponding interaction kinetic energies, 

2.2 Adaptive path integral 

At the slave level, the adaptive path integral (see [^), representing an infinite-dimensional neural network, 
corresponding to the adaptive bilateral joint action ([1]), reads 

{OUT\IN):= /2?[u;,2;,y]e'^[^'^^*-*^l, (5) 



where the Lebesgue integration is performed over all continuous paths = x^{ti) and — y^{tj), while 
summation is performed over all associated discrete Markov fluctuations and jumps. The symbolic differential 
in the path integral ^ represents an adaptive path measure, defined as a weighted product 



N 

T>[w,x,y]^ lim TT dxMy', (i, j = 1, n). (6) 

N^QG 

s=l 

Similarly, in case of the triple joint action, the adaptive path integral reads, 

{OUT\IN) -.^ J P[w;;x,y,z;g]e'^t*"*-*'='*1, (7) 
with the adaptive path measure defined by 

N 

im 



V[w;x,y,z;q]= lim \ \ wf.^.^dx^dy^ dz'^dq'^ , (i, j, fc = 1, n; r~l,...,5n). (8) 



3 Chaos and Bernstein— Brooks Adaptation 

From previous sections, we can see that for modelling a two-actor co-action the Riemannian geometry is 
sufficient. However, it becomes insufficient for modelling the joint action of 3 or more actors, due to an 
intrinsic chaotic coupling between the individual actors. In this case we have to use the Finsler geometry, 
which is a generalization of the Riemannian one. This corresponds to the well-known fact in chaos theory 
that in continuous-time systems chaos cannot exist in the phase plane - the third dimension of the system 
phase-space is neccessary for its existence. This also corresponds to the well-known fact of life that a 
trilateral (or, multilateral) relation is many times more complex then a bilateral relation. (It is so in politics, 
in business, in marriage, in romantic relationships, in friendship, everywhere... Physicists would say that any 
bilateral relation(ship) between Alice and Bob is very likely to crash if Chris comes in between, or at least it 



3 



becomes much more complicated.) This is also related to Lotka-Volterra systems [201 HI], other competing 
systems [22] and predator-prey systems [23l [24l , as well as interacting Morris-Lecar neurons [25] . 

The adaptive path integrals ^ and ([7|) incorporate the local Bernstein adaptation process [TTJ [T^ ac- 
cording to Bernstein's discriminator concept 

desired state SW{t + 1) = current state IW(t) + adjustment step AW(t). 

The robustness of biological motor control systems in handling excess degrees of freedom has been attributed 
to a combination of tight hierarchical central planning and multiple levels of sensory feedback-based self- 
regulation that are relatively autonomous in their operation |13| . These two processes are connected through 
a top-down process of action script delegation and bottom-up emergency escalation mechanisms. There is a 
complex interplay between the continuous sensory feedback and motion/action planning to achieve effective 
operation in uncertain environments (such as movement on uneven terrain cluttered with obstacles). In case 
of three or more actors, the multilateral feedback/planning loop has the purpose of chaos control [14[ I15j . 

Complementing Bernstein's motor/chaos control principles is Brooks' concept of computational suhsump- 
tion architectures [181 119] , which provides a method for structuring reactive systems from the bottom up 
using layered sets of behaviors. Each layer implements a particular goal of the agent, which subsumes that 
of the underlying layers. 

For example, a robot's lowest layer could be "avoid an object", on top of it would be the layer "wander 
around" , which in turn lies under "explore the world" . The top layer in such a case could represent the 
ultimate goal of "creating a map" . In this configuration, the lowest layers can work as fast-responding 
mechanisms (i.e., reflexes), while the higher layers can control the main direction to be taken in order to 
achieve a more abstract goal. 

The substrate for this architecture comprises a network of finite state machines augmented with timing 
elements. A subsumption compiler compiles augmented finite state machine descriptions into a special- 
purpose scheduler to simulate parallelism and a set of finite state machine simulation routines. The resulting 
networked behavior function can be described conceptually as: 

final state w{t + 1) = current state w{t) + adjustment behavior f{Aw{t)). 

The Bernstein weights, or Brooks nodes, wf^ — wf^ (t) in ^ are updated by the Bernstein loop during 
the joint transition process, according to one of the two standard neural learning schemes, in which the 
micro-time level is traversed in discrete steps, i.e., if t — tQ,ti, ...,ts then t + I ^ ti,t2, ...,ts-(-i: 

1. A self-organized, unsupervised (e.g., Hebbian-like [16p learning rule: 

wt^it + 1) = wt,{t) + ^{wtfit) - wtf{t)), (9) 

where a = cr{t), r] = rj{t) denote signal and noise, respectively, while new superscripts d and a denote 
desired and achieved micro-states, respectively; or 

2. A certain form of a supervised gradient descent learning: 

wt^{t + l) = wt,{t)~r^yj(t), (10) 

where 77 is a small constant, called the step size, or the learning rate, and V J(n) denotes the gradient 
of the 'performance hyper-surface' at the t—ih iteration. 
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Both Hebbian and supervised learning are used in local decision making processes, e.g., at the intention 
formation phase (see [1]). Overall, the model presents a set of formalisms to represent time-critical aspects of 
collective performance in tactical teams. Its applications include hypotheses generation for real and virtual 
experiments on team performance, both in human teams (e.g., emergency crews) and hybrid human-machine 
teams (e.g., human-robotic crews). It is of particular value to the latter, as the increasing autonomy of robotic 
platforms poses non-trivial challenges, not only for the design of their operator interfaces, but also for the 
design of the teams themselves and their concept of operations. 

4 Conclusion 

In this paper we have applied the previously developed Life Space Foam approach to model the dynamics 
of co-action by two or more agents. This dynamics is modelled by: 

1. a two-term adaptive joint action, including mental cognitive/motivatonal potential and physical kinetic 
energy, and 

2. its associated adaptive path integral, representing an infinite-dimensional neural network. 

Its feedback adaptation loop has been derived from Bernstein's concepts of sensory corrections loop in human 
motor control and Brooks' subsumption architectures in robotics. The presented model demonstrates that 
in case of trilateral or multilateral joint action we have the strong possibility of chaotic behavior. Potential 
applications of the proposed model in human-robot interaction research are discussed. 
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